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AUTOMATIC IMAGE PLACEMENT AND LINKING 

BACKGROUND OF THE INVENTION 
[01] The present invention relates to the field of digital images, and more 
5 particularly to techniques for generating a customized digital image using one or more digital 
images. 

[02] The availability of images in digital format has grown rapidly 
following the widespread use of devices such as digital cameras, scanners, copiers, and other 
devices that are capable of producing digital images. With the widespread proliferation of 
10 digital images, the need for tools that are capable of handling and manipulating digital images 
■■a is ever increasing. 

,tl [03] Several tools and applications are presently available that allow users 

- to manipulate digital images to create customized digital images as desired by the user. 
:Qj Examples of such applications include various software packages (e.g., Adobe® 
:15 Photoshop®) provided by Adobe Systems, Inc. of San Jose, California, and others. Apart 

from being quite expensive, most of the conventional image processing applications require 
y that the user be well versed in the use of computers and the use of the image processing 
't application. Since many of these applications have steep learning curves, novice users cannot 
3 generally easily use them. Further, even if the user is well versed in the use of these 
20 applications, in order to use the applications, the user has to have access to a computer system 
running the software applications. This may not always be possible given the expensive costs 
associated with these applications. Also, a computer system may not be available at the time 
and place that the digital images are taken. 

[04] Based upon the above, there is a need for simplified techniques that 
25 enable users to create customized images. 

BRIEF SUMMARY OF THE INVENTION 
[05] The present invention provides techniques for generating a customized 
digital image using one or more digital images. According to an embodiment of the present 
30 invention, the customized image generated by the present invention is composed of one or 
more digital images accessible to an image generation system. The positions of the one or 



more images in the customized image are determined by another digital image accessible to 
the image generation system. 

[06] According to an embodiment of the present invention, techniques are 
provided for generating a customized digital image. In this embodiment, the image 
5 generation system (IGS) receives a first digital image. The IGS then determines one or more 
placement regions from the first digital image, each placement region of the one or more 
placement regions identifying a location on the first digital image for placing a digital image 
from a first set of digital images. The IGS then identifies, for each placement region of the 
one or more placement regions, a digital image from the first set of digital images to be 
1 0 placed in the placement region. For each placement region of the one or more placement 
regions, the IGS places a digital image from the first set of digital images identified for the 
placement region in the placement region to generate the customized digital image. 

[07] According to an embodiment of the present invention, the first set of 
;;f digital images comprises digital image copies of a second set of digital images, and the IGS 
Id 5 creates a link between at least one digital image in the customized digital image and the 
g corresponding digital image in the second set of digital images. The IGS can then receive a 
^ user input indicating selection of the at least one digital image in the customized digital 
- image, and retrieve the digital image corresponding to the at least one digital image from the 
■y second set of digital images. 

;4i0 [08] According to another embodiment of the present invention, techniques 

■.a are provided for generating a customized digital image. In this embodiment, the IGS receives 
a signal comprising digital signals representative of a plurality of digital images. The IGS 
determines a template image from the plurality of digital image, and determines one or more 
placement regions from the template image, each placement region of the one or more 
25 placement regions identifying a location on the template image for receiving a digital image 
from the plurality of digital images. The IGS identifies, for each placement region of the one 
or more placement regions, a digital image from the plurality of digital images to be placed in 
the placement region, and for each placement region of the one or more placement regions, 
the IGS places a copy of a digital image from the plurality of digital images identified for the 
30 placement region in the placement region to generate the customized digital image. 

[09] According to yet another embodiment of the present invention, 
techniques are provided for generating a customized digital image. In this embodiment the 
present invention receives a first digital image, analyzes the first digital image to determine a 
first placement region on the first digital image for placing a second digital image, and places 
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the second digital image in the first placement region on the first digital image to generate the 
customized digital image. 

[10] According to an embodiment of the present invention, techniques are 
provided for generating a customized digital image using a digital camera. In this 
5 embodiment, a digital camera is used to capture one or more images and a template image by 
scanning a paper medium. The digital camera then determines one or more placement 
regions from the template image, each placement region of the one or more placement 
regions identifying a location on the template image for placing an image from the one or 
more images captured using the digital camera. The digital camera identifies, for each 
10 placement region of the one or more placement regions, an image from the one or more 

images to be placed in the placement region. For each placement region of the one or more 
placement regions, the digital camera places a copy of an image from the one or more images 
::j identified for the placement region in the placement region to generate the customized digital 
;rj image. 

;8l5 [11] According to another embodiment of the present invention, techniques 

,p are provided for generating a customized digital image using a digital camera. In this 

embodiment, a user may capture one or more images and a template image using a digital 
camera. The template image comprises one or more bounded regions, each bounded region 

II 

'tj of the one or more bounded regions identifying a location on the template image for placing 
;^20 an image of the one or more images captured using the digital camera. The user then obtains 
: * a customized image from the digital camera, wherein the customized digital image is 

generated by placing a copy of at least one image from the one or more images in at least one 
bounded region on the template image. 

[12] The foregoing, together with other features, embodiments, and 
25 advantages of the present invention, will become more apparent when referring to the 
following specification, claims, and accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[13] Fig. 1 is a simplified block diagram of system for generating 
30 customized images according to an embodiment of the present invention; 

[14] Figs. 2A-2G depict simplified examples of template images according 
to an embodiment of the present invention; 

[15] Fig. 3 is a simplified high-level flowchart depicting a method of 
generating a customized digital image according to an embodiment of the present invention; 
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[16] Fig. 4 A depicts simplified images received by an IGS according to an 
embodiment of the present invention; and 

[17] Fig. 4B depicts a simplified customized image generated by an IGS 
according to an embodiment of the present invention. 

5 

DETAILED DESCRIPTION OF THE INVENTION 
[18] The present invention provides techniques for generating a customized 
digital image using one or more digital images. According to an embodiment of the present 
invention, the customized image generated is composed using one or more digital images 
10 (hereinafter referred to as "candidate images") accessible to an image generation system. The 
positions of the one or more candidate images in the customized image are determined by 
another digital image (hereinafter referred to as the "template image") accessible to the image 
2 generation system. 

;f 3 [19] According to an embodiment of the present invention, the template 

015 image is used as a starting point for generating the customized digital image. The template 
*F| image comprises marked regions (hereinafter referred to as "image placement regions") that 

identify one or more locations where the one or more candidate digital images or copies 
! * thereof are to be placed while composing the customized digital image. Each image 
■■r?. placement region on the template image specifies a location for receiving a candidate image 

or a copy thereof. According to an embodiment of the present invention, the image 
■ placement regions specified by the template image also determine the sizes of the candidate 

images in the customized image. According to an embodiment of the present invention, links 
are maintained between the digital images displayed in the customized digital image and the 
original candidate images that are used to compose the customized digital image such that the 
25 original candidate images can be retrieved from the customized digital image. 

[20] Fig. 1 is a simplified block diagram of system 100 (hereinafter referred 
to as "image generation system 100" or "IGS 100") for generating customized images 
according to an embodiment of the present invention. As shown in Fig. 1, IGS 100 is 
coupled to input devices 102, output devices 104, and communication network 106 via 
30 communication links 108. It should be apparent that the configuration depicted in Fig. 1 is 
merely illustrative of an embodiment incorporating the present invention and does not limit 
the scope of the invention as recited in the claims. One of ordinary skill in the art would 
recognize other variations, modifications, and alternatives. 
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[21] Communication links 108 that are used to connect IGS 100 to input 
devices 102, output devices 104, or communication network 106 may be of various types 
including hardwire links, optical links, satellite or other wireless communications links, wave 
propagation links, or any other mechanisms for communication of information. Various 
5 communication protocols may be used to facilitate communication of information via 
communication links 108. These communication protocols may include TCP/IP, HTTP 
protocols, extensible markup language (XML), wireless application protocol (WAP), 
protocols under development by industry standard organizations, vendor-specific protocols, 
customized protocols, and others. 
10 [22] Communication network 106 provides a mechanism allowing IGS 100 

to communicate and exchange data and information with devices or systems coupled to 
communication network 106. These systems may include computer systems, input devices, 
;t output devices, and other systems. Communication network 106 may itself be comprised of 

many interconnected computer systems and communication links. While in one embodiment, 
•015 communication network 106 is the Internet, in other embodiments, communication network 
□ 106 may be any suitable communication network including a local area network (LAN), a 
" wide area network (WAN), a wireless network, an intranet, a private network, a public 
= network, a switched network, an enterprise network, a virtual private network, and the like. 

[23] According to an embodiment of the present invention, IGS 100 is 
:f20 configured to generate a customized image using one or more candidate digital images and a 
template digital image accessible to IGS 100. IGS 100 may receive the digital images to be 
used for generating the customized image from input devices 102 and/or from systems 
coupled to communication network 106. For example, according to an embodiment of the 
present invention, IGS 100 receives digital signals representative of the images from one or 
25 more input devices 102. The images, including the template image and one or more 

candidate images, may also be received by IGS 100 via user interface input devices of IGS 
100. The customized digital image generated by IGS 100 may be stored by IGS 100 or may 
communicated to one or more output devices 104 or other systems or devices via 
communication network 106. 
30 [24] Input devices 1 02 may include a scanner, a digital camera, a video 

camera, or any other device that is capable of generating a digital image. Input devices 102 
may also include readers capable of reading information stored on a computer readable 
storage medium such as a CD, a DVD, a floppy disk, and the like. Output devices 104 may 
include devices that are capable of outputting customized digital images generated by IGS 
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100. Examples of output devices include a display subsystem (e.g., a cathode ray tube 
(CRT), a flat-panel device such as a liquid crystal display (LCD), or a projection device, etc.), 
a printer, a fax machine, a photocopier, a machine that prints photographs, a device capable 
of printing images on a paper medium, and the like. Input devices 102 and output devices 
5 104 may be directly coupled to IGS 100 or may be coupled to IGS 100 via communication 
network 106. 

[25] As shown in Fig. 1, IGS 100 includes at least one processor 110 that 
communicates with a number of subsystems via a bus subsystem 112. The subsystems may 
include a storage subsystem 114, comprising a memory subsystem 116 and a file storage 
10 subsystem 1 1 8, user interface input devices 120, user interface output devices 122, and a 
communication subsystem 124. The user interface input and output devices allow user 
interaction with IGS 100. A user may be a human user, a device, a process, another 
3 computer, and the like. 

ifi [26] Communication subsystem 124 provides an interface that facilitates 

015 communication of information to and from IGS 100. For example, communication 
□ subsystem 124 provides an interface for receiving information from input devices 102 and 
" other systems coupled to communication network 1 06 and for communicating information to 
; = output devices 104 and to systems coupled to communication network 106. According to an 
y embodiment of the present invention, communication subsystem 124 is configured to receive 
:=20 digital signals representative of images to be used for generating the customized image. 
- After a customized image has been generated by IGS 100, digital signals representing the 

customized image may be communicated from IGS 100 using communication subsystem 

124. 

[27] Bus subsystem 112 provides a mechanism for letting the various 
25 components and subsystems of IGS 100 communicate with each other as intended. Although 

bus subsystem 1 12 is shown schematically as a single bus, alternative embodiments of the 

bus subsystem may utilize multiple buses. 

[28] User interface input devices 120 may include a keyboard, a mouse, 

trackball, touchpad, a graphics tablet, a scanner, a barcode scanner, a touchscreen 
30 incorporated into the display, audio input devices such as voice recognition systems, 

microphones, and other types of input devices. In general, use of the term "user interface 

input device" is intended to include all possible types of devices and ways to input 

information to IGS 100. 
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[29] User interface output devices 122 may include a display subsystem, a 
printer, a fax machine, or non-visual displays such as audio output devices. The display 
subsystem may be a cathode ray tube (CRT), a flat-panel device such as a liquid crystal 
display (LCD), or a projection device. In general, use of the term "user interface output 
5 device" is intended to include all possible types of devices and ways to output information 
fromlGS 100. 

[30] Storage subsystem 1 14 may be configured to store the basic 
programming modules and data constructs that provide the functionality of IGS 100. For 
example, according to an embodiment of the present invention, software modules 
10 implementing the functionality of the present invention may be stored in storage subsystem 
114 of IGS 100. For example, software modules that facilitate generation of customized 
images according to the teachings of the present invention may be stored in storage 
i subsystem 1 14. These software modules may be executed by processor(s) 1 10 of IGS 100. 

Storage subsystem 1 14 may also provide a repository for storing images, including candidate 
ll 5 images and template images, which are used to generate a customized image. Customized 
| images generated by IGS 100 may also be stored in storage subsystem 1 14. 
" j [31] Storage subsystem 114 may comprise memory subsystem 116 and file 

4 storage subsystem 1 1 8. Memory subsystem 1 1 6 may include a number of memories 
p including a main random access memory (RAM) 128 for storage of instructions and data 
-20 during program execution and a read only memory (ROM) 126 in which fixed instructions 
a are stored. File storage subsystem 1 1 8 provides persistent (non-volatile) storage for program 
and data files, and may include a hard disk drive, a floppy disk drive along with associated 
removable media, a Compact Disk Read Only Memory (CD-ROM) drive, an optical drive, 
removable media cartridges, and other like storage media. One or more of the drives may be 
25 located at remote locations on other connected computers. 

[32] IGS 100 depicted in Fig. 1 is intended only as a specific example for 
purposes of illustrating an embodiment of the present invention. Many other configurations 
of IGS 100 are possible having more or fewer components than IGS 100 depicted in Fig. 1. 
In alternative embodiments, IGS 100 may be incorporated as part of other systems or devices. 
30 For example, IGS 100 may be incorporated into a digital camera, a copy machine, a scanner, 
and the like. 

[33] As indicated above, the present invention provides techniques for 
generating a customized digital image based upon a template image and one or more 
candidate images. According to an embodiment of the present invention, the template image 
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comprises information identifying locations, known as image placement regions, where the 
one or more candidate digital images or copies thereof are to be placed while composing the 
customized image. Further, according to another embodiment of the present invention, the 
size and manner in which each candidate image is displayed in the customized digital image 
5 may also be specified by the template digital image. According to an embodiment of the 
present invention, the template image also comprises information identifying the candidate 
images to be used for composing the customized image. 

[34] Various different techniques may be used for specifying the image 
placement regions on a template image. These techniques include the use of bounded 
10 regions, marks, glyphs, text, and other techniques. Figs. 2A-2G depict simplified examples 
of template images according to an embodiment of the present invention. 

[35] Fig. 2A depicts a simplified template image 200 according to an 
embodiment of the present invention wherein image placements regions are indicated by 
bounded regions. As shown in Fig. 2 A, three image placement regions 202, 204, and 206 are 
:15 specified in template image 200 marked by square 208, rectangle 210, and oval 212. The 
,| bounded regions mark locations where candidate images or their copies are to be placed when 
" composing the customized image. In addition to specifying the position of the images, the 
> A size of each bounded region also indicates the size of the candidate image to be placed in that 
! y bounded region. Accordingly, bounded regions 202, 204, and 206 indicate both the location 
;f20 and the size of images to be placed in the customized image. It should be apparent that 
- various different bounded regions such as circles, hexagons, stars, asymmetrical bounded 
regions, and others may be used to specify the image placement regions. 

[36] Fig. 2B depicts another simplified template image 220 according to an 
embodiment of the present invention wherein image placements regions are indicated by 
25 bounded regions. Template image 220 comprises three image placement regions 222, 224, 
and 226 marked by square 228, rectangle 230, and oval 232 indicating locations where 
candidate images or their copies are to be placed when composing the customized image. 
Additionally, a number 234 is displayed in each bounded region. As explained below in 
further detail, the number associated with each bounded region is used to identify a particular 
30 candidate image to be placed in the bounded region corresponding to the number when 

composing the customized digital image. For example, number 234-a identifies a candidate 
image to be placed in image placement region 222, number 234-b identifies a candidate 
image to be placed in image placement region 224, and number 234-c identifies a candidate 
image to be placed in image placement region 226. In alternative embodiments, a number 



associated with a bounded region may be displayed in any location proximal to the bounded 
region on the template image. 

[37] Fig. 2C depicts another simplified template image 240 according to an 
embodiment of the present invention wherein image placements regions are indicated by 
5 bounded regions. Template image 240 comprises three image placement regions 242, 244, 
and 246 marked by square 248, rectangle 250, and oval 252 indicating locations where digital 
candidate images or their copies are to be placed when composing the customized image. 
Additionally, text information 254 is displayed in each bounded region. As explained below 
in further detail, text information 254 associated with each bounded region is used to identify 
10 a particular candidate image to be placed in the bounded region when composing the 

customized digital image. For example, text 254-a identifies a candidate image to be placed 
in image placement region 242, text 254-b identifies a candidate image to be placed in image 
;3 placement region 244, and text 254-c identifies a candidate image to be placed in image 
placement region 246. In alternative embodiments, the text information associated with a 

015 bounded region may be displayed in any location proximal to the bounded region on the 

n 

h template image. 

' [38] Fig. 2D depicts a simplified template image 260 according to an 

-i embodiment of the present invention wherein image placements regions are indicated by 
y marks or glyphs displayed in the template image. As shown in Fig. 2D, template image 260 
£20 comprises three marks (or glyphs) 262, 264, and 266 indicating three image placement 
•a regions. Marks 262, 264, and 266 identify locations where candidate images or their copies 
are to be placed when composing the customized image. According to an embodiment of the 
present invention, for each mark, the candidate image included in the customized digital 
image is centered on the location of the mark. It should be apparent that various different 
25 marks or glyphs may be used to specify the image placement regions. 

[39] Fig. 2E depicts a simplified template image 270 according to an 
embodiment of the present invention wherein image placements regions are indicated by text 
displayed in the template image. Template image 270 comprises three text fragments 272, 
274, and 276 that indicate three image placement regions. Each text fragment identifies a 
30 location where a candidate image or a copy thereof is to be placed when composing the 
customized image. According to an embodiment of the present invention, for each text 
fragment, the image included in the customized digital image may be centered on the location 
of the text fragment. It should be apparent that various different text fragments may be used 
to specify the image placement regions. As explained below in further detail, in addition to 
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indicating the location where a candidate image is to be placed, each text fragment also 
comprises information that is used to identify a particular image to be placed in the image 
placement region associated with the text fragment when composing the customized digital 
image. It should be apparent that various different pieces of text or text fragments may be 
5 used to specify the image placement regions and to identify the candidate images to be used 
for composing the customized digital image. The text fragments may also be numbers (282, 
284, and 286) as displayed in template image 280 depicted in Fig. 2F. 

[40] A combination of the techniques described above may also be used to 
specify image placement regions in a template image. Fig. 2G depicts a simplified template 
10 image 290 according to an embodiment of the present invention wherein image placements 
regions are indicated using a combination of different techniques. As shown in Fig. 2G, the 
image placement regions in template image 290 are marked by a bounded region 292, a text 
3 fragment 294, and a mark (or glyph) 296. It should be apparent that various combinations of 
: =: techniques may be used in alternative embodiments of the present invention. 
115 [41] Template images 200, 220, 240, 260, 270, 280, and 290 depicted in 

H: Figs. 2A, 2B, 2C, 2D, 2E, 2F, and 2G, respectively, are merely illustrative of examples of 
" 5 template images that may be used in accordance with the present invention. These examples 

! * are not intended to restrict the scope of the present invention as recited in the claims. It 

y 

should be apparent that various other types of template images may also be used to specify 
;20 image placement regions. A template image may comprise one or more image placement 
>* regions. 

[42] Fig. 3 is a simplified high-level flowchart 300 depicting a method of 
generating a customized digital image according to an embodiment of the present invention. 
Flowchart 300 depicted in Fig. 3 is merely illustrative of an embodiment incorporating the 
25 present invention and does not limit the scope of the invention as recited in the claims. One 
of ordinary skill in the art would recognize other variations, modifications, and alternatives. 

[43] As depicted in Fig. 3, the method is initiated when IGS 100 receives a 
signal requesting generation of a customized digital image (step 302). The signal may be 
received from various sources including from a user interacting with user input devices 120 
30 of IGS 100, from an input device 102 coupled to IGS 100, from a system or device coupled 
IGS 100 via communication network 106, or from any other system or device capable of 
communicating a signal to IGS 100. 

[44] According to an embodiment of the present invention, the signal 
received in step 302 may comprise digital signals representative of digital images, including 
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one or more template digital images and one or more candidate images, to be used for 
composing the customized digital image. Alternatively, the signal may comprise information 
identifying one or more digital images, including one or more template images and candidate 
images, to be used for composing the customized digital image. IGS 100 may then use the 
5 information identifying the images to access the images from a memory location accessible to 
IGS 100. 

[45] If the signal received in step 302 only identifies or comprises signals 
representing a template image or information identifying a template image, and does not 
identify one or more candidate images, the one or more candidate digital images to be used 
10 for composing the customized digital image may be identified from the template image itself 
(as described below in further detail). In this embodiment, the candidate images may be pre- 
stored in a memory location accessible to IGS 100. 

[46] In alternative embodiments of the present invention, the signal 
r? received in step 302 may comprise or identify multiple template images. In this embodiment, 
'Ml 5 IGS 1 00 may automatically select a specific template image to be used for composing the 
6 customized digital image based upon the candidate images identified to be used for 
" j composing the customized digital image. For example, the signal received in step 302 may 
: = identify a first template image comprising two image placement regions and a second 
y template image comprising three image placement regions. If the user has specified three 
£20 candidate images to be used for composing the customized digital image, IGS 100 may 
^ automatically select the second template image as the template image to be used for 
composing the customized digital image. 

[47] In alternative embodiments of the present invention, the signal 
received in step 302 may only identify candidate images and may not identify a template 
25 image to be used for generating the customized digital image. In this embodiment, IGS 100 
may automatically select a specific template image to be used for composing the customized 
digital image from template images accessible to IGS 100. According to an embodiment of 
the present invention, the template image to be used for composing the customized digital 
image is selected based upon the candidate images identified to be used for composing the 
30 customized digital image. For example, the signal received in step 302 may comprise three 
candidate images to be used for composing the customized digital image. IGS 100 may then 
automatically select a template image from a plurality of template images accessible to IGS 
100 that is suited for composing a customized digital image using the three candidate images. 
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[48] Various different techniques may be used for creating a template image 
and providing it to IGS 100. According to an embodiment of the present invention, the 
template image may be created by a user using a word processing application (e.g., MS- 
WORD provided by Microsoft Corporation of Redmond, Washington), a drawing 
5 application, and the other like applications. In alternative embodiments, the template image 
may represent an image of a paper medium (e.g., a paper page) created by a user. The term 
"paper medium" as used in application is intended to include any tangible medium on which 
information may be printed, written, etched, embossed, etc. Examples of a paper medium 
include a paper page, a photograph, a whiteboard, etc. 
10 [49] For example, a user may use the following procedure to create a 

template image using bounded regions to indicate image placement regions (e.g., a template 
image such as template image 200 depicted in Fig. 2A). The user may use a writing 
'■'■.j instrument (such as a pen or pencil) to draw one or more bounded regions (e.g., a square, a 
; 5 *f rectangle, an oval, a circle, etc.) on a paper medium (e.g., a piece of paper) in locations 

;ijl5 desirable to the user. For each bounded region, the user may also write text information 

.r? 

S identifying a candidate image to be placed in the bounded region. The user may then 

generate a digital image of the paper medium using various different techniques. According 
■■a to one technique, the user may take a photograph of the paper medium using a digital camera. 
A special button may be provided on the digital camera which when selected by the user 
20 indicates to the digital camera that the image captured by the digital camera is a template 
,a image. According to another technique, the user may scan the paper medium using a scanner, 
a copier, a fax machine, etc. The digital image of the paper medium generated as a result of 
taking the photograph, scanning, copying, etc. represents the template image and may then be 
provided to IGS 100. Features such as buttons, selection options, etc. may be provided on the 
25 devices used to generate the template image to identify a particular image as a template 
image. Various other techniques may also be used to generate a template image. 

[50] As indicated above, a user may specifically tag a particular image as 
the template image. Accordingly, the signal received in step 302 may comprise information 
identifying a particular image received via the signal as the template image. Information 
30 identifying an image as a template image may be included in the meta-date associated with 
the image and included in the signal received in step 302. As described above, various 
techniques may be provided allowing the user to tag a particular image as a template image. 
For example, if a digital camera is used to generate a template image, a user-selectable button 
or other selection option may be provided on the digital camera to indicate the presence of a 
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template image. All images captured by the digital camera when the "template image button" 
is selected (or when the button is in the activated position) may be tagged as template images. 
Similar buttons or other selection options may be provided in other devices or systems used 
to capture digital images. 
5 [51] The signal received in step 302 may also contain other information or 

meta-data associated with one or more digital images received via the signal. For example, 
as described above, the meta-data may comprise information identifying a particular image as 
the template image. The signal may also comprise other information associated with the 
digital images received via the signal. For example, the meta-data associated with a digital 
10 image may include information indicating a time when the image was captured, a caption or 
other text associated with the image, a unique identifier associated with the image (e.g., a file 
name), text information identifying the contents of the digital image, the location where the 
□ image was taken, the date on which the image was taken, and other information that may be 
:'~ associated or is related to a digital image. The meta-data associated with a digital image may 
015 be used by IGS 100 to determine the identity of the image and to determine an image 
Q ; placement region where the image is to be placed when composing the customized digital 
^ image. 

[52] IGS 100 then identifies a template image to be used for generating the 
y customized digital image based upon information included in the signal received in step 302 
: 20 (step 304). Various different techniques may be used to identify a template image. 

According to an embodiment of the present invention, as described above, the user may 
manually identify a particular image as the template image. For example, when the user 
generates the template image (e.g., by using a digital camera), the user may associate 
information with the image indicating that the image is to be regarded as a template image. 
25 IGS 1 00 may then use the information associated with the image to identify it as a template 
image in step 304. 

[53] If the signal received in step 302 does not comprise information 
identifying a particular image as the template image, IGS 100 may determine a template 
image from the plurality of images received in step 302 by analyzing the digital signals 
30 representing the plurality of images. Various image processing and analysis techniques may 
be used to determine if an image is a template image based upon contents of the image. 
According to one technique, IGS 100 determines the template image from the plurality of 
images based upon the background of each image in the plurality of images. According to 
this technique, IGS 100 analyzes the background of each image and an image with the least 
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variance is identified as the template image. It should be apparent that various other 
techniques known to those skilled in the art may also be used to determine the template image 
from the plurality of images. 

[54] In alternative embodiments, if the signal received in step 302 does not 
5 identify or comprise a template image or alternatively identifies or comprises multiple 

template images, IGS 100 may automatically select a specific template image to be used for 
composing the customized digital image based upon the candidate images identified to be 
used for composing the customized digital image (as described above). For example, if the 
signal received in step 302 comprises a first template image comprising two image placement 
10 regions and a second template image comprising three image placement regions and three 
candidate images to be used for composing the customized digital image, IGS 100 may 
automatically select the second template image as the template image to be used for 
composing the customized digital image. For example, if the signal received in step 302 
comprises three candidate images to be used for composing the customized digital image, 
•115 IGS 100 may then automatically select a template image from a plurality of template images 
p accessible to IGS 100 that is suited for composing a customized digital image using the three 
M - candidate images. 

■ ^ [55] After a template image has been identified, IGS 100 then analyzes the 

[ j contents of the template image to identify one or more image placement regions located in 
320 the template image (step 306). Various different techniques may be used to identify the 
:A image placement regions from the template image. According to an embodiment of the 

present invention where bounded regions are used to identify image placement regions (e.g., 
template images 200, 220, and 240 depicted in Figs. 2A, 2B, and 2C, respectively), IGS 100 
may flood fill the background of the template image. IGS 100 may then detect any remaining 
25 closed regions in the template image that are above a threshold value. For example, 

according to an embodiment of the present invention, IGS 100 may detect closed regions that 
are larger than 200mm 2 . Closed regions exceeding the threshold value may then be identified 
as image placement regions. According to another embodiment of the present invention 
where image placement regions are identified using text fragments or marks (or glyphs) (e.g., 
30 templates 260, 270, and 280 depicted in Figs. 2D, 2E, and 2F, respectively), IGS 100 may 

determine the marks or text printed in the template image by analyzing differences in contrast 
between the background of the template image and the marks or text printed on the template 
image. As part of step 306, IGS 100 may also extract information (e.g., text, numbers, etc.) 
that may be associated with each image placement region that identifies the candidate image 
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to be placed in that image placement region. IGS 100 may also determine meta-data 
associated with one or more images in step 306. 

[56] Several other techniques may also be used to identify image placement 
regions and other information from the template image. Examples of such techniques have 
5 been described in the following references, the entire contents of which are herein 
incorporated by reference for all purposes: 

[57] (1) "Pattern Classification and Scene Analysis", Richard Duda and 
Peter Hart, John Wiley & Sons Inc., 1973, pp. 276-284, 305-308; and 

[58] (2) A. Del Bimbo, S. Santini, and J.L.C. Sanz. "OCR from poor 
10 quality images by deformation of object shapes", in 12 th IAPR International Conference on 
Pattern Recognition, Jerusalem, Israel, October 1994. 

[59] After determining one or more image placement regions, IGS 100 then 
determines a candidate digital image to be placed in each image placement region of the 
template image (step 308). Various different techniques may be used to identify candidate 
015 images to be placed in the image placement regions of the template image. According to one 
'n technique, if the signal received in step 302 identifies or comprises one or more candidate 
"~ 4 images, IGS 1 00 may randomly select images from the one or more candidate images to be 

placed in the one or more image placement regions on the template image. According to 
" another technique, the temporal order or the ordinal order in which the candidate digital 
rf20 images are received by IGS 100 may be used to determine the images to be placed in the one 
or more image placement regions on the template image. Meta-data associated with the 
digital images may also used to determine a candidate image for each image placement 
region. 

[60] As described above, in certain embodiments of the present invention, 
25 for each image placement region, information identifying attributes of a candidate image to 
be placed in the image placement region is specified in the template image. Information 
associated with an image placement region and identifying an image to be placed in the 
image placement regions may be extracted by IGS 100 in step 306. For each image 
placement region, the information associated with the image placement region may then be 
30 used to identify a candidate image to be placed in that image placement region. 

[61] For example, if numbers are associated with image placement regions 
(e.g., templates 220 and 280 depicted in Figs. 2B and 2F, respectively), IGS 100 may select a 
candidate image to be placed in a particular image placement region based upon the order in 
which the candidate images were received by IGS 100. For example, the first candidate 
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image received by IGS 100 may be selected to be placed in an image placement region 
associated with number "1", the second candidate image received by IGS 100 may be 
selected to be placed in an image placement region associated with number "2", the third 
candidate image received by IGS 100 may be selected to be placed in an image placement 
5 region associated with number "3", and so on. 

[62] According to another embodiment, temporal information associated 
with the candidate images may be used to place the candidate images in the image placement 
regions. For example, the oldest candidate image (i.e., the candidate image having the 
earliest time associated with it) received by IGS 100 may be selected to be placed in an image 
10 placement region associated with number "1", the second oldest candidate image received by 
IGS 100 may be selected to be placed in an image placement region associated with number 
"2", the third oldest candidate image received by IGS 100 may be selected to be placed in an 
!~ image placement region associated with number "3", and so on. 

[63] According to another embodiment of the present invention, text 
nl5 information associated with an image placement region may be used to determine a candidate 
: g image to be placed in that image placement region. For example, as depicted in Fig. 2C, an 
image of "John playing tennis" is to be placed in bounded region 242, an image of a "car" is 
: * to be placed in bounded region 246, and an image of a "meeting" is to be placed in bounded 
* region 244. A candidate image identified by the image identifying information may either be 
220 provided in the signal received in step 302 or may otherwise be accessible to IGS 100. 
=1 [64] According to an embodiment of the present invention, IGS 100 

compares the image identifying information associated with an image placement region with 
attributes and/or information (could be part of the meta-data associated with the image) 
associated with the candidate images. If a match is found between a particular image 
25 identifying information associated with a particular image placement region and information 
and/or attributes associated with a particular candidate image, the particular candidate image 
is selected to be placed in the particular image placement region. 

[65] A user who generated the candidate image may configure the 
information and/or attributes associated with a candidate image. This information may be 
30 included in the meta-data associated with the candidate image. In alternative embodiments, 
various image processing techniques may be used to analyze the contents of a candidate 
image to determine information and attributes associated with the candidate image. For 
example, analysis of a particular candidate image may indicate that the image comprises a 
picture of a car. The information identified by the analysis may then be compared with 
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information associated with an image placement region to determine if there is a match. For 
example, the text "Car" is associated with image placement region 246 in Fig. 2C. If the 
contents of a candidate image indicate the presence of a car, then that candidate image will be 
selected for placement in image placement region 246. 
5 [66] After identifying a candidate image to be placed in each image 

placement region printed on the template image, IGS 100 then composes a customized image 
using the identified candidate images (step 310). According to an embodiment of the present 
invention, the candidate images themselves may be placed in their corresponding image 
placement regions to generate the customized digital image. For example, the candidate 
10 images are superimposed onto their respective image placement regions in the template 
image to form the customized image. 

[67] In alternative embodiments of the present invention, for each image 
placement region, IGS 100 generates a digital copy of the candidate image identified (in step 
308) to be placed in the image placement region. The digital copies are then placed in their 

:pl5 corresponding image placement regions to generate the customized digital image. The 

[t customized image may be stored by IGS 100. Alternatively, IGS 100 may communicate the 
customized digital image to an output device 104 or to a system or device coupled to IGS 

■.a 100, either directly or via communication network 106. 

[68] According to an embodiment of the present invention, an image (either 

i20 the candidate image itself or a copy of the candidate image) may be adjusted before being 
placed in an image placement region. For example, if an image placement region is smaller 
or larger than the image to be placed in that image placement region, a scaled copy of the 
image may be placed in the image placement region such that the scaled copy fits inside the 
image placement region. Scaling may be performed in one or more dimensions. For 
25 example, if an image is to be placed in a rectangle shaped image placement region, the image 
may be scaled in both the horizontal and vertical dimensions to fit the rectangular image 
placement region. In alternative embodiments, the image may be scaled proportionally so 
that the image fits inside the bounding box in one dimension and is cropped along the other 
dimension to fit exactly in the image placement region. In yet other embodiments, the image 
30 may be cropped in both dimensions to fit the rectangular image placement region. In 

alternative embodiments, the image may be warped to fit the image placement region. It 
should be apparent that various other techniques known to those skilled in the art may be 
used to place images in the image placement regions. 
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[69] According to an embodiment of the present invention, after the 
customized digital image has been composed according to step 310, links are created between 
the one or more images placed in the customized digital image and the original candidate 
images (step 312). This allows the customized digital image to be used as a user interface for 
retrieving the original candidate images. For example, a user may select (e.g., by using an 
input device) a particular image displayed in the customized digital image and retrieve the 
candidate image corresponding to the particular selected image. 

[70] According to an embodiment of the present invention, hypertext links 
are created between the images displayed in the customized digital image and the original 
candidate images. For example, image maps and the USEMAP attribute provided by the 
HTTP protocol may be used to create links between the customized digital image and the 
candidate images. The following code snippet generates a link between a customized digital 
image composed of a template image and two candidate images, one placed in a rectangle 
between (50,50) and (150,150) and the other placed in a rectangle between (200,50) and 
(300,150). The HTML map element would be as follows: 

[71] <map NAME="clientsidemap"> 

<area SHAPE="rect" COORDS="50,50,150,150" HREF="imagel.jpg"> 
<area SHAPE="rect" COORDS="200,50,300,150" HREF="image2.jpg"> 
</map> 

<a HREF="cgi-bin/serverside.map"> <img SRC="composite-image.jpg" ISMAP 
USEMAP="#clientsidemap"> </a> 

[72] As described above, the present invention provides techniques for 
creating a customized digital image comprising one or more candidate images, or copies 
thereof, based upon a template image. The template image allows the user to specify 
locations for placing images when composing the customized digital image. One or more 
image placement regions may be specified by the user on a template image as desired by the 
user. The user may also control the size of each image in the customized digital image using 
the image placement regions. The template image also allows the user to identify the 
candidate images to be placed in the image placement regions. 

[73] The following section describes a specific example of generating a 
customized digital image by applying the method depicted in Fig. 3. In this specific example, 
IGS 100 receives a signal requesting generation of a customized digital image (per step 302). 
The signal received by IGS 100 comprises four images 400, 402, 404, and 406 depicted in 
Fig. 4A. As depicted in Fig. 4A, the images include three candidate images 400, 402, and 
404, and one template image 406. The signal may also include information or meta-data 
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(e.g., text) that may be associated with the images and that may be used for composing the 
customized digital image. Candidate image 400 depicts a picture of a person "John" playing 
tennis, candidate image 402 depicts a picture of a meeting, and candidate image 404 depicts a 
picture of a car. Template image 406 comprises three bounded regions 410, 412, and 414 
5 identifying image placement regions where the candidate images are to be placed while 
composing the customized image. For each bounded region, template image 406 also 
includes a text fragment 416 identifying a candidate image to be placed in the bounded 
region. 

[74] IGS 100 then identifies image 406 as the template image (per step 
10 304). As described above, various different techniques may be used to identify the template 
image from the plurality of images. IGS 100 then determines that template image 406 
contains three image placement regions corresponding to bounded regions 410, 412, and 414 
3 (per step 306). As part of step 306, IGS 100 also extracts text fragments 416 associated with 

the image placement regions. 
•015 [75] IGS 100 then determines a candidate image to be placed in each image 

p placement region in template image 406 (per step 308). Accordingly, IGS 100 determines 
'~ 4 that a candidate image corresponding to "John playing tennis" is to be placed in bounded 

region 410, a candidate image corresponding to "Meeting" is to be placed in bounded region 
; 412, and a candidate image corresponding to "Car" is to be placed in bounded region 414. 

=f20 As described above, various different techniques may be used to match candidate images to 
<* specific image placement regions based upon information associated with the image 

placement regions and information related to the candidate images. IGS 100 then composes a 
customized image 420 (as depicted in Fig. 4B) by placing copies of the candidate images in 
their corresponding image placement regions (per step 310). As shown in Fig. 4B, the 
25 individual candidate images have been scaled to fit the bounded regions specified in template 
image 406. 

[76] According to an embodiment of the present invention, IGS 100 also 
creates links between each image displayed in customized image 420 and its original 
candidate image. For example, IGS 100 may create a link between image 422 displayed in 
30 customized image 420 and candidate image 400, a link between image 424 displayed in 

customized image 420 and candidate image 402, and a link between image 426 displayed in 
customized image 420 and candidate image 404. Customized image 420 can thus be used as 
a user interface for retrieving candidate images 400, 402, and 404. For example, a user may 
click on image 424 using an input device such as a mouse and in response candidate image 
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402 is retrieved and displayed to the user. The links thus allow a user to interact with the 
candidate images. 

[77] The following section describes another specific example of generating 
a customized digital image according to the teachings of the present invention. In this 
5 example, IGS 100 is incorporated into a digital camera that is used to generate the customized 
digital image. Using the digital camera, a user may capture a sequence of images. For 
example, the user may use the digital camera to take a photograph of John playing tennis 
(image 400 depicted in Fig. 4A). The user may then take a photograph of a meeting which 
the user attends (image 402 depicted in Fig. 4A) followed by a photograph of a car (image 
10 404 depicted in Fig. 4A) that the user wishes to purchase. 

[78] The user may then decide to generate a customized digital image based 
upon the sequence of images. The user may use a writing instrument (e.g., a pen, a pencil) to 
draw one or more bounded regions (e.g., a square, a rectangle, an oval, a circle, etc.) on a 
paper page (e.g., a page taken from the user's notebook) in locations desirable to the user. 
;Q15 For each bounded region, the user may write text information proximal to the bounded region 
S identifying an image to be placed in the bounded region. The user may then select or activate 
^ a "template image button" on the digital camera and take a picture of the paper page (image 
:i 406 depicted in Fig. 4A). Images captured when the "template image button" is selected or 
: y activated are tagged as template images. 

320 [79] Image 406 is then identified by the digital camera as the template 

image. The digital camera then analyzes the template image to identify three image 
placement regions corresponding to bounded regions 410, 412, and 414. The digital camera 
also extracts text fragments associated with the bounded regions. The digital camera then 
determines that a candidate image corresponding to "John playing tennis" is to be placed in 

25 bounded region 41 0, a candidate image corresponding to "Meeting" is to be placed in 
bounded region 412, and a candidate image corresponding to "Car" is to be placed in 
bounded region 414. The digital camera then composes a customized image (image 420 
depicted in Fig. 4B) by placing copies of the candidate images in their corresponding image 
placement regions. The digital camera may modify the images to fit the bounded regions 

30 specified in the template image. 

[80] The digital camera then creates links between each image displayed in 
the customized image and its corresponding candidate image. For example, the digital 
camera creates a link between image 422 displayed in customized image 420 and candidate 
image 400, a link between image 424 displayed in customized image 420 and candidate 
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image 402, and a link between image 426 displayed in customized image 420 and candidate 
image 404. The user may then use customized digital image 420 as a user interface for 
retrieving candidate images 400, 402, and 404. For example, the user may click on image 
424 using an input device such as a mouse and in response candidate image 402 is retrieved 
5 and displayed to the user. 

[81] It should be apparent that the examples described above are not 
intended to limit the scope of the present invention as recited in the claims. One of ordinary 
skill in the art would recognize other variations, modifications, and alternatives. 

[82] While the invention has been described with reference to digital 
1 0 images, other digital objects may also be used instead of the images. Techniques provided by 
the present invention may be used to place other types of digital objects (e.g., audio objects, 
video objects, and other live or static multimedia objects) in placement regions specified by a 
template image. Links may be created between the objects placed in the customized image 
--; and the original candidate objects such that the original candidate objects can be retrieved 
015 from the customized image. Accordingly, the scope of the present invention is not restricted 
| to digital images. 

'~ 4 [83] Although specific embodiments of the invention have been described, 

•a various modifications, alterations, alternative constructions, and equivalents are also 

encompassed within the scope of the invention. The described invention is not restricted to 
£20 operation within certain specific data processing environments, but is free to operate within a 
plurality of data processing environments. Additionally, although the present invention has 
been described using a particular series of transactions and steps, it should be apparent to 
those skilled in the art that the scope of the present invention is not limited to the described 
series of transactions and steps. The present invention may be used by users for a variety of 
25 applications including to create customized images, photo albums based upon the customized 
images, scrapbooks based upon the customized images, and the like. 

[84] Further, while the present invention has been described using a 
particular combination of hardware and software, it should be recognized that other 
combinations of hardware and software are also within the scope of the present invention. 
30 The present invention may be implemented only in hardware, or only in software, or using 
combinations thereof. 

[85] The specification and drawings are, accordingly, to be regarded in an 
illustrative rather than a restrictive sense. It will, however, be evident that additions, 
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subtractions, deletions, and other modifications and changes may be made thereunto without 
departing from the broader spirit and scope of the invention as set forth in the claims. 
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